Specialty Courts Recidivism Study: 2014-2021 Cohorts
Abstract
This study investigates patterns of recidivism and probation success within three of the First Circuit Specialty Courts: Hawaii Drug Court (HDC), Mental Health Court (MHC), and Veterans Treatment Court (VTC). Generally, recidivism rates did not change over the study period within the Specialty Courts. Although the recidivism rate sat at 52.3%, 43.8%, and 33.3% for HDC, MHC, and VTC, respectively, only 12.2%, 5.6%, and 7.7% of clients were convicted of new charges or had their probation revoked. Time to recidivate averaged between 10.9 and 12.1 months. Property offenders were more likely to recidivate than drug or “other” offenders, but no other differences were statistically detectable. There were no sex/gender differences in recidivism, although there were a few race/ethnicity and age differences. Among graduates of the Specialty Courts, recidivism rates dropped to 36.4%, 27.9%, and 22.6% for HDC, MHC, and VTC, respectively. Analyses of LSI-R scores revealed that risk levels were weakly predictive of reoffending. Limitations in comparing these data to historical statewide recidivism data or future recidivism data, or comparing between the Specialty Courts, are discussed, as well as future directions for conducting rigorous studies of the Specialty Courts.
Introduction
Hawaii’s Specialty Courts provide intensive supervision and support to individuals who have not had success on regular probation. The Judiciary has undertaken an initial study using historical data to establish baseline numbers on recidivism and to investigate the effectiveness of these courts. This study investigates patterns of recidivism and probation success with three of the First Circuit Specialty Courts: Hawaii Drug Court (HDC), Mental Health Court (MHC), and Veterans Treatment Court (VTC).
This report examines recidivism in terms of rearrests, probation revocations, and criminal contempt of court. The sample included probationers admitted to a Specialty Court in the First Circuit between 2014 - 2021. Probationers were monitored over a three-year follow-up period from the date they entered a Specialty Court.
Method
Sample
Recidivism among felony probationers in the First Circuit Specialty Courts was examined over a precise 36-month period starting from the date a probationer was admitted to a Specialty Court. The entire cohort was comprised of 551 probationers from the following Specialty Courts:
- 384 HDC probationers
- 89 MHC probationers
- 78 VTC probationers
Secondary Data Sources
The study data set originated from multiple information systems.
Rearrest data came from the Criminal Justice Information System (CJIS) database, housed with the Office of the Attorney General. Data was pulled in March 2025, and included the listing of any and all state charges reported since each offender’s respective date of admission to the Specialty Courts, as well as the date of arrest and the disposition of charges. The date of the arrest was used to determine the time to recidivate, or length of time elapsed from the follow-up date to the arrest date, and the disposition of the new charge was used to determine the final outcome of the alleged offense. In situations involving multiple charges filed on the same arrest date, the most severe charge (i.e., class A felony, class B felony, or class C felony) became the recorded recidivism event.
Probation data, including a list of probationers along with the Specialty Court they were admitted to, the date of admission, and graduation status, were provided by the Specialty Court Administrator in stand alone spreadsheets. Additional information about supervision cases (e.g., initial offense, severity of charge, demographics, etc.) was extracted from the CX database, which underlies Hawaii State Judiciary’s probation system, in April 2025.
Risk classification (LSI-R) data was pulled from the Community Corrections Adult Assessment information system created by Cyzap Inc. The LSI-R data was pulled in March 2025, and includes risk assessments conducted on Specialty Court probationers going back to 2014, the start of the study period.
Results
Recidivism for the first fourteen analyses was defined as a new arrest, probation revocation, or criminal contempt of court. New arrests were determined by taking the most recent arrest after admission to the Specialty Courts.
Extreme caution is warranted in drawing conclusions about the relative effectiveness of the different courts from this data. Except when statistical tests are reported, these numbers should be treated as basic baseline estimates of recividism, and attempts to compare are likely invalid and should generally be avoided. See the discussion for a detailed explanation of the perils and pitfalls in comparing the courts to each other, to general probation, or to future recidivism rates.
Full Sample
Results for the full sample of clients admitted to the Specialty Courts between CY 2014 - 2021 are reported first. Results for only those probationers who graduated from the Specialty Courts are reported after the results for the full sample.
Analysis 1: Overall Recidivism Rates
Recidivism rates were computed for each Specialty Court between CY2014-2021.
| Specialty Court | r | Sample size | Recidivism rate |
|---|---|---|---|
| HDC | 201 | 384 | 52.3% |
| MHC | 39 | 89 | 43.8% |
| VTC | 26 | 78 | 33.3% |
| Total | 266 | 551 | 48.3% |
| Note: | |||
| r = Number of people who reoffended. |
Analysis 2: Recidivism Rates by Yearly Cohort
Recidivism rates for each Specialty Court were disaggregated by cohort, in which a cohort was defined as the calendar year in which probationers were admitted to each Specialty Court. In other words, a probationer admitted into Hawaii Drug Court on September 1st, 2015 would be counted toward the 2015 HDC cohort whereas a probationer admitted into the Mental Health Court on March 18th, 2019 would be counted toward the 2019 MHC cohort.
There were no statistically detectable differences in recidivism rates in HDC between 2014 and 2021. There were also no statistical differences in MHC or VTC, and even when all probationers were combined, there were no differences across cohorts.
| cohort | Drug Court | Mental Health Court | Veterans Treatment Court | Combined |
|---|---|---|---|---|
| 2014 (N = 101) | 55.3% (r = 47, n = 85) | 40.0% (r = 4, n = 10) | 16.7% (r = 1, n = 6) | 51.5% (r = 52, n = 101) |
| 2015 (N = 62) | 50.0% (r = 22, n = 44) | 20.0% (r = 1, n = 5) | 46.2% (r = 6, n = 13) | 46.8% (r = 29, n = 62) |
| 2016 (N = 65) | 36.1% (r = 13, n = 36) | 22.2% (r = 2, n = 9) | 30.0% (r = 6, n = 20) | 32.3% (r = 21, n = 65) |
| 2017 (N = 72) | 42.6% (r = 23, n = 54) | 53.8% (r = 7, n = 13) | 0.0% (r = 0, n = 5) | 41.7% (r = 30, n = 72) |
| 2018 (N = 91) | 56.7% (r = 34, n = 60) | 47.1% (r = 8, n = 17) | 28.6% (r = 4, n = 14) | 50.5% (r = 46, n = 91) |
| 2019 (N = 72) | 60.8% (r = 31, n = 51) | 46.7% (r = 7, n = 15) | 33.3% (r = 2, n = 6) | 55.6% (r = 40, n = 72) |
| 2020 (N = 38) | 59.1% (r = 13, n = 22) | 80.0% (r = 4, n = 5) | 54.5% (r = 6, n = 11) | 60.5% (r = 23, n = 38) |
| 2021 (N = 50) | 56.3% (r = 18, n = 32) | 40.0% (r = 6, n = 15) | 33.3% (r = 1, n = 3) | 50.0% (r = 25, n = 50) |
| Total (N = 551) | 52.3% (r = 201, n = 384) | 43.8% (r = 39, n = 89) | 33.3% (r = 26, n = 78) | 48.3% (r = 266, n = 551) |
| Note: | ||||
| r = Number of people who reoffended. | ||||
| n = Court sample size. | ||||
| N = cohort sample size. |
Analysis 3: Time to Recidivism
Recidivism was analyzed by time to reoffense. Longer times to reoffend can indicate gradual desistance from crime.
| specialty_court | 1 Year Follow-up Period | 2 Year Follow-up Period | 3 Year Follow-up Period | 3+ Year Follow-up Period |
|---|---|---|---|---|
| HDC | 34.4% (r = 132, n = 384) | 45.6% (r = 175, n = 384) | 52.1% (r = 200, n = 384) | 52.3% (r = 201, n = 384) |
| MHC | 22.5% (r = 20, n = 89) | 37.1% (r = 33, n = 89) | 43.8% (r = 39, n = 89) | 43.8% (r = 39, n = 89) |
| VTC | 20.5% (r = 16, n = 78) | 25.6% (r = 20, n = 78) | 33.3% (r = 26, n = 78) | 33.3% (r = 26, n = 78) |
| Total | 30.5% (r = 168, n = 551) | 41.4% (r = 228, n = 551) | 48.1% (r = 265, n = 551) | 48.3% (r = 266, n = 551) |
| Note: | ||||
| r = Number of people who reoffended. | ||||
| n = Court sample size. |
Analysis 4: Recidivism Rates by Disposition Status
Recidivism rates were analyzed by disposition status. A rearrest does not necessarily indicate new charges, let alone a new conviction. (Of course, failure to pick up a new arrest does not mean a person has not reoffended.) About 40% of new arrests/offenses resulted in acquittal, dismissal, or charges not being filed. Among Specialty Court clients, 12.2%, 5.6%, and 7.7% of them were convicted of new charges or had their probation revoked in HDC, MHC, and VTC, respectively.
It is important to note that these figures may underestimate the number of cases that result in conviction or revocation as the CJIS database, which contains the disposition data reported here, may not contain the most up-to-date disposition data. As a result, cases coded as pre-trial may in fact have been disposed as convictions (or non-convictions), underestimating those counts.
| Disposition | HDC | MHC | VTC | All |
|---|---|---|---|---|
| Other | 3.9% (r = 15) | 6.7% (r = 6) | 2.6% (r = 2) | 4.2% (r = 23) |
| Acquitted | 20.8% (r = 80) | 15.7% (r = 14) | 14.1% (r = 11) | 19.1% (r = 105) |
| Pending - Early pretrial | 11.5% (r = 44) | 9.0% (r = 8) | 9.0% (r = 7) | 10.7% (r = 59) |
| Pending - Late pretrial | 3.9% (r = 15) | 6.7% (r = 6) | NA (r = NA) | 3.8% (r = 21) |
| Guilty | 12.2% (r = 47) | 5.6% (r = 5) | 7.7% (r = 6) | 10.5% (r = 58) |
| Total | 52.3% (r = 201) | 43.8% (r = 39) | 33.3% (r = 26) | 48.3% (r = 266) |
| Note: | ||||
| r = Number of people who reoffended. |
All dispositions that appeared in the rearrest records provided by CJIS are listed below. The following mappings from dispositions (values in the columns) to disposition categories (column heads: “Acquitted/Dismissal,” “Pending - Early pretrial,” Pending - Late pretrial,” “Guilty,” or “Other”) were used:
| Acquitted/Dismissal | Pending - Early pretrial | Pending - Late pretrial | Guilty | Other |
|---|---|---|---|---|
| NO ACTION WAS TAKEN BY THE COURT | SUBJECT WAS TAKEN TO THE INTAKE SERVICE CENTER | THE CHARGE WAS CONTINUED UNTIL | PROBATION REVOKED; SUBJECT WAS RE-SENTENCED | SUBJECT WAS RELEASED TO THE CIRCUIT COURT CELLBLOCK |
| NO ACTION; CHARGE CLOSED BY PROSECUTOR | BAIL WAS RESET FOR DRUG COURT CASE | SUBJECT WAS RELEASED PENDING FURTHER INVESTIGATION | SUBJECT WAS FOUND GUILTY | REVOCATION OF BAIL OR SUPERVISED RELEASE WAS DISMISSED |
| SUBJECT WAS RELEASED; PROSECUTION DECLINED | SUBJECT WAS TAKEN TO THE INTAKE SERVICE CENTER | SUBJECT WAS RELEASED ON BAIL | PROBATION REVOKED; THE ORIGINAL SENTENCE WAS RESUMED OR MODIFIED | THE CASE-IN-CHIEF IS COMPLETE BUT NO DISPOSITION WAS FOUND FOR THIS ARREST |
| THE CHARGE/CASE WAS STRICKEN | SUBJECT WAS TAKEN TO DISTRICT COURT FOR ARRAIGNMENT | PAROLE WAS REVOKED | RELEASE ON BAIL OR SUPERVISED RELEASE WAS MODIFIED OR REVOKED | |
| THE CHARGE WAS DISMISSED/NPQ WITHOUT PREJUDICE | THE CASE-IN-CHIEF IS COMPLETE BUT NO DISPO WAS FOUND FOR THIS CHARGE | |||
| THE CHARGE WAS DISMISSED | A PENAL SUMMONS WAS ISSUED | |||
| THE CHARGE WAS NOLLE PROSEQUI | ||||
| SUBJECT WAS ACQUITTED | ||||
| SUBJECT WAS RELEASED; NO CHARGE | ||||
| PROSECUTION WAS DECLINED |
Analysis 5: Recidivism Rates by Recidivism Type
Recidivism rates were analyzed by recidivism type. Reoffending included new arrests, probation revocations, and criminal contempt of court.
Recidivism rates differed statistically between the specialty courts for some of the recidivism types. Specifically, HDC had higher rearrest but lower revocation rates than the other two courts.
| Recidivism Type | HDC | MHC | VTC | All |
|---|---|---|---|---|
| Criminal Arrest | 32.8% (r = 126) | 16.9% (r = 15) | 9.0% (r = 7) | 26.9% (r = 148) |
| Probation Revocations | 7.3% (r = 28) | 11.2% (r = 10) | 11.5% (r = 9) | 8.5% (r = 47) |
| Criminal Contempt of Court | 12.2% (r = 47) | 15.7% (r = 14) | 12.8% (r = 10) | 12.9% (r = 71) |
| Other Violations | 0.0% (r = 0) | 0.0% (r = 0) | 0.0% (r = 0) | 0.0% (r = 0) |
| Total | 52.3% (r = 201) | 43.8% (r = 39) | 33.3% (r = 26) | 48.3% (r = 266) |
| Note: | ||||
| r = Number of people who reoffended. |
Analysis 6: Average Time to Recidivate by Recidivism Type
Time to recidivate did not statistically differ between the specialty courts for any of the recidivism types. Specifically, time to rearrest was no different for HDC, MHC, OR VTC. The same was true for revocations and criminal contempt of court. Note that an increase in time to rearrest can indicate gradual desistance from crime.
Time to recidivate was measured in months.
| Recidivism Type | HDC | MHC | VTC | Combined |
|---|---|---|---|---|
| Criminal Arrest | 12 (r = 126) | 13.3 (r = 15) | 18.4 (r = 7) | 12.4 (r = 148) |
| Probation Revocations | 10.6 (r = 28) | 13.3 (r = 10) | 9.4 (r = 9) | 11 (r = 47) |
| Criminal Contempt of Court | 8.1 (r = 47) | 9.9 (r = 14) | 7 (r = 10) | 8.3 (r = 71) |
| Other Violations | NA (r = 0) | NA (r = 0) | NA (r = 0) | NA (r = 0) |
| Note: | ||||
| r = Number of people who reoffended. |
Analysis 7: Recidivism Rates by Initial Offense Type
Recidivism rates statistically differed between initial offense categories. Specifically, the recidivism rate was statistically greater for property offenders than drug offenders or “other” felony offenders. All other comparisions were not statistically different. Initial offenses were categorized by chapters and sections of the Hawaii Revised Statutes according to the category mappings tab below.
Figure 7
| Initial offense category | r | n | Recidivism rate |
|---|---|---|---|
| Non-sex Violent Offenses | 23 | 50 | 46.0% |
| Sex Offenses | 0 | 0 | |
| Property Offenses | 167 | 296 | 56.4% |
| Drug Offenses | 69 | 183 | 37.7% |
| Felony Other | 7 | 22 | 31.8% |
| Note: | |||
| r = Number of people who reoffended. | |||
| n = Sample size of probationers in each initial offense category. |
| category | description | rule applied to charge codes |
|---|---|---|
| Non-sex violent offenders | robbery | if chapter = “708” and section = 84[0-2] |
| Non-sex violent offenders | Abuse of family or household members | if chapter = “709” and section = 906 |
| Non-sex violent offenders | All other | if chapter = “707” and section = 7[01256][0-9] |
| Sex offenses | if chapter = “707” and section = 7[3-4][0-49] | |
| Property offenses | if chapter = “708” and section = 8[0-35-9][0-9] | |
| Drug offenses | Offenses related to drugs and intoxicating compounds | if chapter = “712” and section = 12[45][0-9] |
| Drug offenses | Uniform Controlled Substances Act | if chapter = “329” |
| Felony other | weapons offenses, driving-related offenses, flight/escape, habitual offender, etc. | any remaining offenses not already categorized |
Analysis 8: Recidivism Rates by Initial Offense Type and Recidivism Type
Recidivism rates did not statistically differ between initial offense categories when broken down by recidivism type. Initial offenses were categorized according to the category mappings described above.
| Recidivism type | Non-sex Violent Offenses | Sex Offenses | Property Offenses | Drug Offenses | Felony Other |
|---|---|---|---|---|---|
| Criminal Arrest | 26.0% (r = 13, n = 50) | NA (r = 0, n = 0) | 32.4% (r = 96, n = 296) | 19.1% (r = 35, n = 183) | 18.2% (r = 4, n = 22) |
| Probation Revocations | 12.0% (r = 6, n = 50) | NA (r = 0, n = 0) | 9.8% (r = 29, n = 296) | 5.5% (r = 10, n = 183) | 9.1% (r = 2, n = 22) |
| Criminal Contempt of Court | 8.0% (r = 4, n = 50) | NA (r = 0, n = 0) | 14.2% (r = 42, n = 296) | 13.1% (r = 24, n = 183) | 4.5% (r = 1, n = 22) |
| Other Violations | 0.0% (r = 0, n = 50) | NA (r = 0, n = 0) | 0.0% (r = 0, n = 296) | 0.0% (r = 0, n = 183) | 0.0% (r = 0, n = 22) |
| Note: | |||||
| r = Number of people who reoffended. | |||||
| n = Sample size of probationers in each initial offense category. |
Analysis 9: Recidivism Rates by Sex/Gender
Recidivism rates did not statistically differ between sex/gender groups in any of the Specialty Courts. Data was missing for two probationers, who were categorized as “UNKNOWN.”
| SEX | HDC | MHC | VTC |
|---|---|---|---|
| MALE | 53.9% (r = 171, n = 317) | 46.6% (r = 27, n = 58) | 33.3% (r = 24, n = 72) |
| FEMALE | 43.1% (r = 28, n = 65) | 38.7% (r = 12, n = 31) | 33.3% (r = 2, n = 6) |
| UNKNOWN | 100.0% (r = 2, n = 2) | NA (r = 0, n = 0) | NA (r = 0, n = 0) |
| Note: | |||
| r = Number of people who reoffended. | |||
| n = Sample size of probationers for each sex/gender group within a Specialty Court. |
Analysis 10: Recidivism Rates by Race/Ethnicity
Recidivism rates differed between race/ethnicity groups, but only in Drug Court. Specifically, probationers of all races/ethnicities except African-Americans had lower recidivism rates than Samoans among Drug Court probationers. All other comparisons were not statistically significant.
| specialty_court | Hawaiian-Part Hawn | Caucasian | Filipino | Japanese | Samoan | African-American | All Others |
|---|---|---|---|---|---|---|---|
| drug | 52.0% (r = 65, n = 125) | 53.8% (r = 43, n = 80) | 44.4% (r = 28, n = 63) | 46.4% (r = 13, n = 28) | 85.0% (r = 17, n = 20) | 69.2% (r = 9, n = 13) | 47.3% (r = 26, n = 55) |
| mental_health | 39.1% (r = 9, n = 23) | 44.4% (r = 12, n = 27) | 33.3% (r = 3, n = 9) | 57.1% (r = 4, n = 7) | 66.7% (r = 2, n = 3) | 62.5% (r = 5, n = 8) | 33.3% (r = 4, n = 12) |
| veterans | 57.1% (r = 4, n = 7) | 37.5% (r = 12, n = 32) | 20.0% (r = 2, n = 10) | 66.7% (r = 2, n = 3) | NA (r = NA, n = NA) | 27.3% (r = 3, n = 11) | 23.1% (r = 3, n = 13) |
| Note: | |||||||
| r = Number of people who reoffended. | |||||||
| n = Sample size of probationers for each race/ethnicity group within a Specialty Court. |
Analysis 11: Recidivism Rates by Age
Recidivism rates differed between age groups, but only in Drug Court. Overall, there was a partial step-like decline in recidivism with age. Specifically, under 20-year-olds recidivated at a higher rather than the 50-59-year-olds (note that the sample size for the under 20-year-olds was so small and the margins of error so high that it did not statistically differ from the other age groups). The 20-29-year-olds had significantly higher recidivism rates than all other groups except for the under 20s. The 30-39-year-olds had higher recidivism rates than the 40-49 and 50-59-year olds. All other comparisons were not statistically significant.
| specialty_court | Mean age (yrs) | < 20 years old | 20-29 years old | 30-39 years old | 40-49 years old | 50-59 years old | +60 years old |
|---|---|---|---|---|---|---|---|
| drug | 35.8 | 75.0% (r = 3, n = 4) | 69.9% (r = 95, n = 136) | 53.7% (r = 65, n = 121) | 36.6% (r = 26, n = 71) | 23.9% (r = 11, n = 46) | 16.7% (r = 1, n = 6) |
| mental_health | 40.2 | NA (r = 0, n = 0) | 44.0% (r = 11, n = 25) | 57.1% (r = 12, n = 21) | 36.4% (r = 8, n = 22) | 35.3% (r = 6, n = 17) | 50.0% (r = 2, n = 4) |
| veterans | 42.6 | NA (r = 0, n = 0) | 54.5% (r = 6, n = 11) | 30.0% (r = 9, n = 30) | 15.8% (r = 3, n = 19) | 33.3% (r = 3, n = 9) | 55.6% (r = 5, n = 9) |
| Note: | |||||||
| r = Number of people who reoffended. | |||||||
| n = Sample size of probationers for each age group within a Specialty Court. |
Graduates Only
Here we focus on recividism among probationers who graduated from the Specialty Courts. This data should be taken on its own. Comparing graduates to the full sample comes with a major risk of drawing incorrect conclusions. Graduates likely differ in many ways - known and unknown - from the full sample. Because of that, it is difficult if not impossible to determine with confidence whether and why recidivism rates differ (or not) between the two groups.
Analysis 12: Overall Recidivism Rates - Graduates
Recidivism rates for graduates were computed for each Specialty Court between CY2014-2021. The estimates for Drug Court graduates are consistent with estimates from a meta-analysis of evaluations of 92 adult drug courts (89 from the United States, two from Canada, and one from Guam). 1
| Specialty Court | r | Sample size | Recidivism rate |
|---|---|---|---|
| HDC | 90 | 247 | 36.4% |
| MHC | 12 | 43 | 27.9% |
| VTC | 14 | 62 | 22.6% |
| Total | 116 | 352 | 33.0% |
| Note: | |||
| r = Number of people who reoffended. |
Analysis 13: Recidivism Rates by Yearly Cohort - Graduates
Recidivism rates for each Specialty Court were disaggregated by cohort, in which a cohort was defined as the calendar year in which probationers were admitted to each Specialty Court.
There were no statistically detectable differences in recidivism rates in HDC between 2014 and 2021. There were also no statistical differences in MHC or VTC, and even when all probationers were combined, there were no differences across cohorts.
| cohort | Drug Court | Mental Health Court | Veterans Treatment Court | Combined |
|---|---|---|---|---|
| 2014 (N = 58) | 34.0% (r = 16, n = 47) | 20.0% (r = 1, n = 5) | 16.7% (r = 1, n = 6) | 31.0% (r = 18, n = 58) |
| 2015 (N = 39) | 34.6% (r = 9, n = 26) | 33.3% (r = 1, n = 3) | 30.0% (r = 3, n = 10) | 33.3% (r = 13, n = 39) |
| 2016 (N = 46) | 30.8% (r = 8, n = 26) | 0.0% (r = 0, n = 5) | 6.7% (r = 1, n = 15) | 19.6% (r = 9, n = 46) |
| 2017 (N = 46) | 28.6% (r = 10, n = 35) | 50.0% (r = 3, n = 6) | 0.0% (r = 0, n = 5) | 28.3% (r = 13, n = 46) |
| 2018 (N = 55) | 34.2% (r = 13, n = 38) | 33.3% (r = 2, n = 6) | 18.2% (r = 2, n = 11) | 30.9% (r = 17, n = 55) |
| 2019 (N = 50) | 45.7% (r = 16, n = 35) | 33.3% (r = 3, n = 9) | 33.3% (r = 2, n = 6) | 42.0% (r = 21, n = 50) |
| 2020 (N = 30) | 50.0% (r = 9, n = 18) | 66.7% (r = 2, n = 3) | 55.6% (r = 5, n = 9) | 53.3% (r = 16, n = 30) |
| 2021 (N = 28) | 40.9% (r = 9, n = 22) | 0.0% (r = 0, n = 6) | NA (r = 0, n = 0) | 32.1% (r = 9, n = 28) |
| Total (N = 352) | 36.4% (r = 90, n = 247) | 27.9% (r = 12, n = 43) | 22.6% (r = 14, n = 62) | 33.0% (r = 116, n = 352) |
| Note: | ||||
| r = Number of people who reoffended. | ||||
| n = Court sample size. | ||||
| N = cohort sample size. |
Analysis 14: Time to Recidivism - Graduates
Recidivism was analyzed by time to recidivate. Longer times to recidivate can indicate gradual desistance from crime. The estimates for Drug Court appear to conform to national estimates of recidivism among drug court graduates. 2
| specialty_court | 1 Year Follow-up Period | 2 Year Follow-up Period | 3 Year Follow-up Period | 3+ Year Follow-up Period |
|---|---|---|---|---|
| HDC | 18.2% (r = 45, n = 247) | 27.1% (r = 67, n = 247) | 36.4% (r = 90, n = 247) | 36.4% (r = 90, n = 247) |
| MHC | 7.0% (r = 3, n = 43) | 18.6% (r = 8, n = 43) | 27.9% (r = 12, n = 43) | 27.9% (r = 12, n = 43) |
| VTC | 14.5% (r = 9, n = 62) | 16.1% (r = 10, n = 62) | 22.6% (r = 14, n = 62) | 22.6% (r = 14, n = 62) |
| Total | 16.2% (r = 57, n = 352) | 24.1% (r = 85, n = 352) | 33.0% (r = 116, n = 352) | 33.0% (r = 116, n = 352) |
| Note: | ||||
| r = Number of people who reoffended. | ||||
| n = Court sample size. |
LSI-R and Recidivism
UNDER CONSTRUCTION!
How well did The Level of Service Inventory–Revised (LSI-R) relate to recidivism? Here we look at the predictive and dynamic validity of the LSI-R among the Specialty Court clients.
- Predictive validity of initial LSI-R
- Predictive validity of most recent LSI-R
- Dynamic validity of change from initial to most recent LSI-R
Analysis 15: Predictive validity of initial LSI-R
Bivariate correlations between risk levels and recidivism were computed. The correlations between risk levels and recidivism for all Specialty Courts and for HDC were significant, but the effect sizes were small (.10 < r < .30).
| specialty_court | Surveillance | High | Medium | Low | Administrative | Unknown |
|---|---|---|---|---|---|---|
| HDC | 57.9% (r = 11, n = 19) | 67.1% (r = 100, n = 149) | 49.4% (r = 38, n = 77) | 83.3% (r = 10, n = 12) | 42.1% (r = 16, n = 38) | 29.2% (r = 26, n = 89) |
| MHC | 40.0% (r = 6, n = 15) | 64.7% (r = 22, n = 34) | 0.0% (r = 0, n = 4) | 60.0% (r = 3, n = 5) | 0.0% (r = 0, n = 3) | 28.6% (r = 8, n = 28) |
| VTC | 50.0% (r = 1, n = 2) | 56.3% (r = 9, n = 16) | 42.9% (r = 9, n = 21) | 0.0% (r = 0, n = 3) | 27.3% (r = 3, n = 11) | 16.0% (r = 4, n = 25) |
| Note: | ||||||
| r = Number of people who reoffended. | ||||||
| n = Court sample size. |
Analysis 15.1: Predicted Probabilities of Rearrest Based on Risk Levels
A mulitvariable binary logistic regression was run to examine the relationship between risk level and reoffending, while statistically adjusting for other variables, including sex, ethnicity, age, and initial offense type. The logistic regression revealed a significant coefficient for risk level (β = 0.03, p = .006), suggesting that risk level is predictive of reoffending, even after statistically adjusting for differences in sex, ethnicity, age, and initial offense type.
The analysis yielded an odds ratio (OR) of 1.039 with a 95% CI = [1.01, 1.07]. This indicates the odds of rearrest increases by 3.87% with a 95% CI [1.12%, 6.77%] when a probationers risk score increases by one point.
The resulting regression model was then used to predict the probability of rearrest as a function of risk level.
Analysis 15.2: ROC/AUC Analyses
UNDER CONSTRUCTION!
Analysis 16: Predictive validity of most recent LSI-R
UNDER CONSTRUCTION!
Analysis 17: Dynamic validity of change from initial to most recent LSI-R
UNDER CONSTRUCTION!
Changes in offense severity among reoffenders
Although some Specialty Court probationers reoffended, a more subtle measure of desistance is evidence that people who reoffend are committing less serious offenses.
UNDER CONSTRUCTION!
Discussion
The results above provide baseline estimates of recidivism rates and time to recidivate for the First Circuit Specialty Courts, including HDC, MHC, and VTC. Generally, recidivism rates did not change over the study period within the Specialty Courts. Although the recidivism rate as defined sat at 52.3%, 43.8%, and 33.3% for HDC, MHC, and VTC, respectively, only 12.2%, 5.6%, and 7.7% of clients were convicted of new charges or had their probation revoked. Time to recidivate averaged between 10.9 and 12.1 months. Property offenders were more likely to recidivate than drug or “other” offenders, but no other differences were statistically detectable. There were no sex/gender differences in recidivism, although there were a few race/ethnicity and age differences.
For graduates of the Specialty Courts, recidivism rate as defined sat at 36.4%, 27.9%, and 22.6% for HDC, MHC, and VTC, respectively. Recidivism rates for graduates did not change over the study period within the Specialty Courts. Only 16.2% of graduates recidivated after 12 months.
Initial LSI-R scores were only weakly predictive of reoffending. This could suggest that risk assessment procedures may be in need of revision/updating or that probation officers are effectively managing their clients. It may be comparable to a group of patients with medical condition, some more serious than others as rated by a disease severity score. Although the expected mortality rate of the serious cases may be initially higher, if a new medication is effective at treating the condition, we would expect those initial disease severity scores to no longer predict mortality rates.
Limitations
Comparing between Specialty Courts
Given the limits of observational data, attempts to compare recidivism estimates between each of the Specialty Courts comes with the risk of drawing invalid conclusions, or at least conclusions that rest on weak, ambiguous evidence. For instance, although there are apparent differences in the recidivism rates between the Specialty Courts, comparing between them is not straightforward for a number of reasons. For example, the average age of clients in the three programs vary from 35.8 years in HDC, 40.2 years in MHC, and 42.6 years in VTC. Given the age-crime curve,3 , 4 , 5 a difference in recidivism rates is expected simply due to the age differences across the three groups.
Comparing to future recidivism rates
If these numbers are used as comparison points for future recidivism studies, they would only be valid if future samples and future circumstances (crime rates, employment rates and other economic factors, capacity for supervision/probation staffing levels, availability of rehabilitation services, etc.) are comparable to the current time frame. More often than not, samples and circumstances change, often in ways that are difficult to quantify and can invalidate comparisons. Given those limitations, these baseline measures may be of limited utility for evaluating the effectiveness of the Specialty Courts over time.
Comparing to historical recidivism rates
Comparisons to past recidivism rates are also fraught. The first fourteen analyses of the current study largely adopted the methods of and applied the recidivism definition from the Interagency Council on Intermediate Sanctions (ICIS) annual statewide recidivism study. However, some important changes were made either to address issues and limitations with prior analyses or to customize analyses for the current study.
Differences with the statewide ICIS recidivism study: Including deferrals
Each supervision case is defined by one and only one charge. The pre-2017 ICIS Recidivism Study identified the highest severity charge on a supervision case and then removed any probationers with deferrals, including deferred no context pleas and deferred guilty pleas. One potential issue with removing deferrals after identifying the highest severity charge is that if a probationer had multiple supervision cases or multiple charges within a case, and only the highest severity charge had a deferral, they would be excluded from the study even though they had other charges not disposed as deferrals.
For the current study, subject matter experts in the Specialty Courts were consulted, and it was decided that deferrals would not be excluded.
Not only does this affect the composition of the sample, it creates a potential difference with the ICIS sample. When the court grants a deferral, it typically does so for first time offenders convicted of less serious offenses. By excluding them from the ICIS recidivism study, the ICIS cohort is potentially on average higher risk than a sample that includes deferrals, although by how much is unknown.
Differences with the statewide ICIS recidivism study: Excluding misdemeanor probationers
Although most of the probationers in the statewide ICIS recidivism study are felony probationers, there are typically also a handful of misdemeanor probationers. Because the Specialty Courts only admit felony probationers, there were no misdemeanor supervision cases in the study sample. Notably, this creates another difference in risk levels between the ICIS recidivism study and the current study. In this case, including misdemeanor probationers would lower the average risk level of the ICIS sample.
Differences with the statewide ICIS recidivism study: The follow-up date
Critically, the ICIS recidivism study defines arrests for the most recent charge after the start of the probation term. In other words, the follow-up date is the probation start date.
However, nearly all of the probationers in the Specialty Courts have already served part of one or more terms of regular probation prior to being admitted into Specialty Court. The follow-up date for Specialty Court probationers is defined not by the start date of the initial probation term but as the date admitted to Specialty Court.
This creates two potentially significant differences with the ICIS recidivism study. The first is that Specialty Court probationers on average have received a greater doasge of programming and services, which could push recidivism rates down. The second is that Specialty Court probationers will on average be older than regular probationers, which could further reduce recidivism rates given the age-crime curve.6 , 7 , 8 Together, these considerations obscure a meaningful, valid comparison between the specialty Courts and the ICIS sample.
Differences with the statewide ICIS recidivism study: Initial risk levels
Higher risk individuals, all else equal, are more likely to recidivate than lower risk probationers. The Specialty Courts are largely composed of people who have failed regular probation at least one time, making up a higher risk sample. This consideration, taken alone, predicts higher recidivism rates among Specialty Court probationers relative to regular probationers. But without a control group, how much this increased risk translates into increased recidivism, and how much of it is blunted by the specialized and intense case planning provided by the Specialty Courts, is unknown.
In practice, this consideration cannot be taken alone but at least has to be considered alongside the treatment and services being provided. Although it cannot be determined with confidence with the data currently available, if Specialty Court reoffense rates were lower than regular probation, it would suggest some impact of the Specialty Courts, although the magnitude of the effect is not straightforward to estimate. It could in fact represent an underestimate of the impact of Specialty Court because the people admitted to these courts necessarily had higher recidivism rates than regular probationers prior to joining the Specialty Courts. In other words, Specialty Court and regular probationers were not at the same starting point with respect to risk to begin with. (Conversely, if the recidivism rates for Specialty Court were higher than regular probation, it would not necessarily imply the Specialty Courts were ineffective). With this type of secondary data and retrospective observational design, there are many moving parts that make it difficult to know with confidence the effectiveness of the Specialty Courts.
*Differences with general probation: Motivation as a form of selection bias
Specialty Court probationers chose to petition into Specialty Court. The fact that they petitioned into it provides some measure of evidence that they are motivated to change their lives through treatment and supervision. Although initially they may not fully recognize how hard the process will be in order to graduate from Specialty Court, they have committed to that goal. Regular probationers may also be strongly motivated to successfully complete probation, but anyone not showing at least the more explicit and obvious signs of committment to change would not be considered, let alone accepted, into Specialty Court. This creates potentially an important psychological difference between probationers in Specialty Court and those under regular probation supervision that could further explain differences in performance measures.
Future directions
The current approach to studying the Specialty Courts relies on secondary data and a non-experimental research design. The recidivism estimates from this type of research provides some descriptive data, but due to the various uncontrolled differences between groups and other factors not being held constant, the evidence available is generally insufficient to answer questions about relative effectiveness, absolute effectiveness, and whether effectiveness of the Specialty Courts has changed over time.
An alternative approach to studying the Specialty Courts that goes beyond the limitations of an observational research design would include running randomized control trials (RCTs) to study the effectiveness of various interventions and programs related to rehabilitation. When RCTs/experiments are not feasible, another approach would involve using causal inference methods with quasi-experimental designs. To use causal inference, a strong theory about the causes of recidivism would be necessary, as well as careful measurement on those causal factors to determine how much each one contributes to recidivism. Both RCTs and causal inference approaches could assist in identifying the primary root causes of reoffending and what aspects of the Specialty Courts are and are not effective at reducing recidivism.
Acknowledgments
Special thanks to Greg Uwono, Specialty Court Administrator, and Specialty Court Judges Clarissa Malinao and Matthew Viola, for working closely with the research team in developing the recidivism study. Special recognition goes to Greg for updating and checking data discrepancies and missing data, and answering many, many questions about the Specialty Courts. Mahalo nui to Judges Malinao and Viola for allowing us to observe status review hearings and answering questions.
Research assistance was provided by Ian Strieter, PhD student in Psychology at UH Manoa, and Jourdan Owens, MS student in Counseling Psychology at Chaminade University. Finally, a big mahalo to Vincent Borja, ICIS Project Coordinator, for providing LSI-R data and to Wendy Char and her team at the Hawaii Criminal Justice Data Center within the Office of the Attorney General for pulling rearrest records for this study.
Footnotes
Mitchell, O., Wilson, D. B., Eggers, A., & MacKenzie, D. L. (2012). Assessing the effectiveness of drug courts on recidivism: A meta-analytic review of traditional and non-traditional drug courts. Journal of Criminal Justice, 40, 60-71..↩︎
Roman, J., Townsend, W., & Bhati, A. S. (2003). Recidivism Rates for Drug Court Graduates: Nationally based estimates. Urban Institute..↩︎
Farrington, D. P. (1986). Age and crime. Crime and justice, 7, 189-250.↩︎
Hirschi, T., & Gottfredson, M. (1983). Age and the explanation of crime. American journal of sociology, 89, 552-584.↩︎
Wilson, M., & Daly, M. (1985). Competitiveness, risk taking, and violence: The young male syndrome. Ethology and sociobiology, 6, 59-73.↩︎
Farrington, Age and crime, 189-250.↩︎
Hirschi & Gottfredson, Age and the explanation of crime, 552-584.↩︎
Wilson & Daly, Competitiveness, risk taking, and violence: The young male syndrome, 59-73.↩︎